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Abstract 

We consider the multilinear polynomial-form process 

^W = X] a^^ ...ai^e„-i^ ...e„-i^, 

l<il <...<i/^,<oo 



obtained by applying a multilinear polynomial- form filter to i.i.d. sequence {e;} where {ui} is regularly 
^^, , varying. The resulting sequence {X{n)} will then display either short or long memory. Now consider a 

^ , ' vector of such X{n), whose components are defined through different {a^j's, that is, through different 

multilinear polynomial-form filters, but using the same {ei}. What is the limit of the normalized partial 

sums of the vector? We show that the resulting limit is either a) a multivariate Gaussian process with 
C^ ' Brownian motion as marginals, or b) a multivariate Hermite process, or c) a mixture of the two. We also 

identify the independent components of the limit vectors. 



^ ; 1 Introduction 

f^ ' A linear process is generated by applying a linear time-invariant filter to i.i.d. random variables. A common 

O^ , model for stationary long-range dependent (LRD) (or long-memory) time series is a causal linear process 

^*l ' with regularly varying coefficients as the lag tends to infinity, namely, X{n) = X^i^i o.i^n-i, where the e^'s 

^^ , are i.i.d. with mean and finite variance, and the coefficients satisfy Ui = i L{i) with < d < 1/2 and L 

^3 ' is a slowly varying function at infinity (i.e., L{x) > when x is large enough and lima;_>.oo L{\x)/L{x) ~ 1 

^^ ' VA > 0). Note that < d < 1/2 implies J^'iLi kd = oo but J^'ili "-l < o<2> so X(n) is well-defined in L^ 

sense. It is well-known that the autocovariance ^{n) of X{n) is regularly varying with power 2d — 1, and 
that the partial sum oi X{n) when suitably normalized converges to fractional Brownian motion with Hurst 
k> ' index H ^ d+ 1/2. See for example Chapter 4.4 of [Giraitis et al., 2012]. 

}_( , A family of processes related to multilinear processes are the so-called multilinear polynomial-form pro- 

_^_' cesses (or discrete-chaos processes), which are defined as 

^i"^)^ X! fli, ...aj^e„_i, ...e„_jj^, (1) 

l<ii<...<ifc<oo 

where X^i^i af < co and e^'s are i.i.d., and the k > is the order. X{n) is also said to belong to a discrete 
chaos of order k. The multilinear polynomial-form process X{n) can be viewed as generated by nonlinear 
filters applied to i.i.d. random variables when A: > 1. We call such a nonlinear filter defined in (1) a 
multilinear polynomial-form filter. Such a process often arises from considering a polynomial of a linear 
process (see, e.g., [Surgailis, 1982]). 
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If Gi ~ i'^^^L{i) with < d < 1/2, when fc > 1, that is, except for hnear processes, the partial sum of 
X{n) when suitably normalized no longer converges to a fractional Brownian motion, but depending on d 
and fc, it either converges to a Hermite process if X{n) is still LRD, or it converges to a Brownian motion 
a X{n) is short-range dependent (SRD), that is, when the autocovariance oi X{n) is absolutely summable. 
See [Giraitis et al., 2012] for more details. 

In Statistics, however, one often needs convergence when X{n) is a vector rather than a scalar. This 
leads us to the following question: if one applies different multilinear polynomial-form filters to the same 
i.i.d. sequence {cj}, what is the joint limit behavior of the J-vector of the partial sums? More specifically, 
assume that {ej} are i.i.d with mean and variance 1. Consider the multilinear polynomial-form processes: 

l<ii<...<ifc . <oo 

where fci, . . . , fcj are orders for Xi{n), . . . , Xj{n) respectively, {uij} are regularly varying coefficients. Let 

, [Nt] 

where Aj{N) is a normalization factor such that limAr^oo Var[y,jv(l)] = ^t J = ^, ■ ■ ■ i J- We want to study 
the limit of the following vector process as A'^ — > oo: 

YN{t):^{Yi,N{t),...,YjMt))- (3) 

Depending on {fljj} and fcj, the components of YAr(i) can be either purely SRD, or purely LRD, or a mixture 
of SRD and LRD. In [Bai and Taqqu, 2012], a similar type of problem is considered for nonlinear functions 
of a LRD Gaussian process. We show here that the results for multilinear polynomial-form processes are 
similar to those in [Bai and Taqqu, 2012]. But in the present context, we are able to provide a complete 
answer to the problem, in contrast to what happens in [Bai and Taqqu, 2012], where the mixed SRD and 
LRD case is stated as a conjecture in some cases. 

In addition, we distinguish here between two types of SRD sequences, one involving a linear process 
(fc — 1) and one involving higher-order multilinear polynomial-form process (fc > 2). For the first type of 
process, we get dependence with the LRD limit component, while for the second type, we get independence. 

The paper is organized as follows. In Section 2, some properties of multilinear polynomial-form processes 
are given and the univariate limit theorems under SRD and LRD are reviewed. In Section 3, we state the 
multivariate convergence results in three cases: a) pure SRD case, b) pure LRD case and c) mixed SRD and 
LRD case. The result of the general mixed case is stated in Theorem 3.5. In Section 4, we give the proofs 
of the results in Section 3. 

2 Preliminaries 

In this section, we introduce some facts about multilinear polynomial-form processes as well as the univariate 
limit theorems for the partial sums. 

Suppose that X{n) is the multilinear polynomial-form process in (1). Note first, the condition X^i^i '^1 < 
oo guarantees that X(n) is well-defined in L^, since 

E[X{nf]= J2 <---<<oo. 

We use throughout a convention a^ = for i < 0. One can compute the autocovariance of X(n) as: 

7('^) = 22 an+i^tti^ ...an+i^ai^, n G Z. (4) 

l<ii<...<ifc<oo 

The following proposition describes the asymptotic behavior of 7(n) under the assumption: a^ — i'^^^L(i), i > 
1, 0<d<l/2. 



Proposition 2.1. Suppose ^{n) is defined in (4), ai = z^ ^L{i), « > 1 with < d < 1/2 where L is slowly 
varying at infinity. Then ^{n) = L*{n)n'^'^^~^ for some slowly varying function L* and 

dx = l-H^-d). (5) 

Proof. First wc claim that as n — > oo, 

oo 

J2 an+iai - n^'^-^B(d, 1 - 2d)L{nf , 

i=l 

where B{.,.) is the beta function. Indeed, one can check by Potter's bound for slowly varying functions 
(Theorem 1.5.6 in [Bingham et al., 1989]) and the Dominated Convergence Theorem that as n — > oo 



oo 



1 Y-„ Y^/Sd-i/1 , i ^d-i L{i) L{n + i) I 






L(n)'^n'^'^ ^ ^-^ ^-^ n n L(n) L(n) n 



oo 



u^-'il + uf-'du = B{d, 1 - 2d). 



Then note that as n ^- oo, 7(n) ^ (fcO~^(X]i^i ctn+iCi)'' (the diagonal terms with ip — iq are negligible as 
n — >■ oo. See also [Giraitis et al., 2012] p. 109). Now we can deduce that 

7(n) = n'=(2d-i)^*(^) ^ n2''^-iL*(n), 
where L*{n) = {kl)-^B{d, 1 - 2dfL{nf^. U 

Remark 2.2. According to Proposition 2.1, when d < ^(1 — \) (or k{2d— 1) < —1), we have ^ \l{n)\ < oo, 
and when d > i(l — i), we have ^ |7('T^)| = oo. So if we assume Ui = i'^^^L{i), < d < 1/2, the quantity 
i(l — ■^) is the boundary between SRD and LRD. 

We now define precisely what SRD and LRD mean for a multilinear polynomial- form process X{n), and 
from then on wc use this definition whenever we talk about SRD or LRD. 

Definition 2.3. Let X{n) be a multilinear polynomial-form process given in (1) with coefficient {oi}, 
autocovariance j{n) and order k. We say that X{n) is 

(a) SRD, if for some d G (— oo, ^(1 ^ ■^)) and some constant c > 0, 

oo 

\a^\ < c^-\ i>l, J2 ^(") > 0' (^) 

n— — oo 

(b) LRD, if for some d G (^(1 — ■^), ^) and some L slowly varying at infinity, 

a, = i^'-'Lit), z > 1, 1(1 - i) < d < 1/2. (8) 

Remark 2.4. The d in (7) and (8) are different. In the SRD case, {oi} is only assumed to decay faster 
than a power function, which implies ^^ |7('t^)| ^ X]n(X]fci l^^n-i-i'^il)'' < oo by (6), and the particular d 
chosen will not matter in the limit. While in the LRD case, the regularly varying assumption on {a^} yields 
a memory parameter dx ~ h — k{^ — d) given by (5), and thus d plays an important role. 

Next we consider the cross-covariance between of two multilinear polynomial-form processes obtained by 
applying two multilinear polynomial-form filters to the same {ci}. In particular, set 



Xi{n) = E Oil ...flip e„_ii ...e„_ip, (9) 

l<ii<...<ip<oo 

X2in) = E 6ii ...6i,e„-n •••e„_i,. (10) 



l<ii<...<i„<oo 



Xi{n) and X2(n) share the same {ei} but the sequences {ai} and {bi} can be different. Then the cross- 
covariance is 

liAn)^Cov{X,{n),X,{0)) = r ^ ^'^' _ , (11) 

(2^1<n<...<ifc<oo '^il'^n+ii ■ ■ -flifcOn+ifc p — q — K 

for any n € Z. 

The following result will be used to obtain the asymptotic cross-covariance structure between the SRD 
components of YAr(i) in (3). 

Proposition 2.5. Let Xi{n) and X2{n) be given as in (9) and (10) with p = q = k, and are both SRD in 
the sense of Definition 2.3. Then the cross-covariance 7i,2('t-) — Cov(Xi(n), X2(0)) is absolutely summable: 



J2 l7i,2N|<cx). (12) 



n— — oo 



Moreover, (12) implies that as N -^ oo, 

•^"^ 7^ E ^i(")' -7^ E ^2(n) ^ (ti A t2) E ^i.2(n). (13) 

y ^ n— 1 ^ n— 1 / n— — oo 

In addition, if k ^ 1, then 

oo 

y^ 7i,2(n-) = cri(T2, (14) 

n— — OO 

™/iere a^ = E„ Gov (X, (n), X, (0)) = lim^^oo Var (^ ^1=1 ^. (")) , .? = 1, 2. 

Proof. Suppose that {oi} and {bi} satisfy the bound in (7) with d — di and d — d2 respectively. Using a 
similar argument as in the proof of Proposition 2.1, one can show that 

l7i,2(n)|<|n|'^('^i+'^^-i)L*(n) 

for some function L*{n) slowly varying at ±oo. Since by assumption di,d2 < |(1 — ■^), which implies that 
k{di + ^2 - 1) < -1, so we have J2n l7i,2(")| < oo- 

The proof of (13) follows from the argument of Lemma 4.1 in [Bai and Taqqu, 2012], after noting that 

([Nti] [Nt2] \ [Nti] [Nt2] 

J2 Mn), E ^2(n) Nee Ti.2("i - ^2). 
n— 1 n— 1 / ni^ln2 — 1 

Now let's prove (14). When k ~ 1, Xi{n) = X^i^i '^i^n-i, X2{n) — X^i^i biCn-i- Note that by (7) with 
fc = 1, we have X^i kd < o^ ^^d X^i l^il < o^- The cross-covariance is 7i,2(«) ~ Cov(Xi(n),X2(0)) ~ 
YnLif^i^i+n- By Fubini, 



00 00 00 00 



XI 7i,2(n) = XI ^a,bn+^^C^ai){^bn). 



n— — 00 n— — 00 i— 1 i— 1 n— 1 

^°o ^.A2_Y^ „, /^\ _ ^2 o„^ ^Y^°o h.\'2 -X^ ^,^(„\_„2 



Since (X)^! a*) = E„7i(»^) == cr?, and (X^i &») = E„72(«) = erf, we get relation (14). D 

Let's now review the limit theorems for partial sum of a single multilinear polynomial-form process X(n). 
Let the notation " — — >■ " denote convergence in finite-dimensional distributions. 



Theorem 2.6. Suppose that X{n) defined in (1) is SRD. Then 

[Nt] 



^^^Xinl'^BV). 



where A{N) is a normalization factor to guarantee unit asymptotic variance att — \, and B{t) is the standard 
Brownian motion. In fact, A{N) ^ a^/N as iV —> oo with a^ = X]n7('^)- 

Theorem 2.7. Suppose that X{n) defined in (1) is LRD. Then 

. [Nt] 

where A{N) is a normalization factor to guarantee unit asymptotic variance at t ~ 1, and Z\ (t) is the 
so-called Hermite process defined with the aid of the k-tuple Wiener-Ito stochastic integral denoted by Ik{.) 
([Major, 1981]): 

Zf\t) = /fe(/S) := ^^ /l;^(xi, . . .,Xk)W{dx,) . . . W{dxk) (15) 

where the prime ' indicates the exclusion of the diagonals Xi — Xj for i ^ j , W{.) is Brownian random 
measure, and 

fi%u---,^k)=ak,d f f[is-x,f+-'ds, (16) 

with 

{k{d - 1/2) + 1) {2k{d - 1/2) + 1) r(l - d)'' ^ ^/^ 



'""^'^ ' fc!r(d)fer(i - 2d)fe 

(See [Pipiras and Taqqu, 2010].) In fact, A{N) - ciVi+(''-i/2)*=L(7V)'=/2 as TV ^ oo for some c> 0. 

For the proofs of Theorem 2.6 and Theorem 2.7, we refer the reader to Chapter 4.8 in [Giraitis et al., 
2012], respectively Theorem 4.8.1 and Theorem 4.8.2 ^. One may also compare Theorem 2.6 and Theorem 2.7 
to their counterparts in the context of nonlinear functions of a LRD Gaussian process, stated as Theorem 
2.1 and Theorem 2.2 in [Bai and Taqqu, 2012]. 

3 Multivariate convergence results 

In this section, we state the multivariate joint convergence results for the vector process Yjv(i) in (3). Recall 
that Yat is normalized so that the asymptotic variance of every component at t = 1 equals 1. 

Theorem 3.1. Pure SRD Case. If all the components in Yjv defined in (3) are SRD in the sense of (1), 
then 

YN{t)^^-B(t) = {B,{t),...,BAt)), 

where B(t) is a multivariate Gaussian process with Bi{t), . . . , Bj{t) being standard Brownian motions with 

Cov(Bp(s),B,(t)) = (sAi)^^, (17) 



^The results of Chapter 4.8 in [Giraitis ct al., 2012] do not include a slowly varying function, nor convergence of finite- 
dimensional distributions in the case of Theorem 2.6. But they can be easily extended. 



n— — oo n— — oo 

oo oo 

f^p,9 = E 7p,9H := E Cov(Xp(n),X,(0)). 



T/ie normalization Aj (N) in (2) satisfies Aj (N) ^ ctj \/ N as iV —> oo . 

Remark 3.2. ap^q is well-defined by Proposition 2.5. 

Remark 3.3. In view of (11) and (17), if all the components of the Yjv(i) have different order, then the 
limit components Bj{t) uncorrelated and hence independent. Otherwise, they are in general dependent and 
their covariance is given by (17). 

Theorem 3.4. Pure LRD Case. If all the components in Yjv defined in (3) are LRD in the sense of (8) 
with d ^ di, . . .dj respectively, then 

Y^{t)f^-Zi{t)^{zf^^\t),...,zf;'\t)\ 

where Z^^ ^ (t) are Hermite processes sharing the same random measure W{.) in their Wiener-Ito integral 
representations. The normalization Aj{N) in (2) satisfies Aj{N) ^ CjN^~^^'^^~^^'^^''^ L{N)''^/^ as N ^ oo 

(k ■) 

for some Cj > 0. The processes Z^,^ , j = 1, . . . , J are dependent. 

We now consider the mixed SRD and LRD case. 
Theorem 3.5. Mixed SRD and LRD Case. Break Y^ in (3) into 3 parts: 

Yat = {YN,Sn^N,S2i^ N,l), 

where within Yjv,Si (J s-^^ — dimensional) every component is SRD and has order kj^Si ~ 1; within Yn^s2 
(J $2 — dimensional) every component is SRD and has order kj^s2 ^ 2, and within Yjv^i ( J l — dimensional) 
every component is LRD. Then 

YN{t) = (Y^,s,(t),Y^,5.(t),Y^,i(i)) ^^- (W(t),B(t),Z^-(t)), (18) 

where B(t) := [Bi{t), . . . , Bjg (t)) is the multivariate Gaussian process appearing in Theorem 3.1, Z^^ (i) 
is the multivariate Hermite process appearing in Theorem 3.4, 

W{t)^{W{t),...,W{t)), (19) 

where W{t) is the Brownian motion integrator for defining Z^^ (t) (see (15)), and B(i) is independent of 
(W(t),Z^-Jt)). 

Remark 3.6. To understand heuristically why B(i) and (W(i), Z^^ {t)) are independent, note that YN,S2{t) 
belongs to chaos of order > 2, and is thus uncorrelated with Y M.s^it) which belongs to first-order chaos, and 
also uncorrelated with the random noise {ci} which also belongs to the first-order chaos, and which after 
summing becomes asymptotically the Brownian measure W{.) defining Zj^(i). 

Remark 3.7. The independence between B(t) and Z ^^ (t) for kj^L > 3 (the order in LRD component) in 
the framework of [Bai and Taqqu, 2012], is only a conjecture. 

The convergence results in the above theorems are stated in terms of convergence in finite-dimensional 
distributions, but one can show that in some cases they extend to weak convergence in D[0, 1]'^ (J-dimensional 
product space where D[0, 1] is the space of Cadlag functions on [0, 1] with uniform metric). 

Theorem 3.8. Weak convergence in _D[0, 1]'^. 

1. Theorem 3.4 holds with " ^^■' " replaced by weak convergence in Z)[0,1]'^; 



2. Ij the SRD component in Theorem 3.1 (or Theorem 3.5) satisfies either of the following conditions: 

a. There exists m>Q, such that the coefficients Oi in (1) are zero for all i > m; 

b. {si} are i.i.d. Gaussian. 



c. The order fc = 1 and E{\ei\'^'^ ) < oo for some S > 0; 



d. The order k > 2, X^i^i l*^*! < °° '^^^ -^{\^i\^) < °°/ 

then Theorem 3.1 (or Theorem 3.5) holds with " ^-^' " replaced by weak convergence in D[0, 1]"^. 

Note that tightness in the SRD case resuhs from an interplay between the dependence structure and the 
finitcness of the moments. 

4 Proofs for the multivariate convergence results 

4.1 Pure SRD case 

Proof of Theorem 3.1. Following the idea of [Giraitis ct al., 2012] p. 108., we define the truncated multilinear 
polynomial-form processes: 



XJ"^(n)= Y^ a,i,j ...ai,^.,j e„_,, ...e„_i,^., j = l,...,J, (20) 



V'V — 



where m > maXj{kj}. Note that x!j"'\n) is m-dependent. Set (crj"^)^ ^ E„ Gov rxj"V),XJ"^(0) 

(assume m is large enough so that cj " > 0), and ap^ ~ J2n ^°^ ( ^p l*^): Xq' (0) j which is well-defined 
due to Proposition 2.5. 
Set 

[Nt] [Nt] 

J ^ 71—1 ^ J V -i * n— 1 

Theorem 3.1 follows if one shows that as A^ — ^ oo, 

Yf\t) ^: {Y^^^{tl...y^}{t)) ^^■B(")(t) := (<)(t), . . . , ^"'(t)) (21) 

where _B (t)'s arc Brownian motions with cross-covariance structure: 

Am) 

Cov(i3M(ti),i?^"'H^2)) = (^1 A ^2) ,J:\^y p,q=l,...,J, (22) 

a'p V^ 

and as 771 —7- cx), 

<^f^^'^., '^^"^-^'^P,. (23) 

as well as for any j — 1, . . . , J and i > 0, as to —> 00, 

.(m) 



Var 



^A7W-^A',.W ^0 (24) 



uniformly in N. Indeed, combining (21), (23) and (24), one obtains the desired convergence: 

YAr(t) = (lV,i W, • • • , yN,j{t)) ^^- B(t) :- (Bi(t), . . . , Bj{t)) 



Relations (23) and (24) can be shown using the same type of arguments in [Giraitis et al., 2012] p. 108. 
We thus only need to show (21) and (22). By the Cramer- Wold device, it suffices to show that for any 

(ci,...,cj)eR^, 

E^.^i'?W - ^;^E(E^.^rN) '^- E^.<^W - G{t) (25) 

where G{t) is a non-standardized Brownian motion. This follows from the fact that the sequence {X), CjX^^ ('^)}r 
is m-dependent and is thus subject to functional central limit theorem ([Billingsley, 1956] Theorem 5.2), 
which includes convergence in finite-dimensional distributions. The asymptotic cross-covariance structure 
(22) follows from Proposition 2.5. D 

4.2 Pure LRD case 

Proof of Theorem 3.4- The joint convergence is proved by combining Theorem 4.8.2. and Proposition 14.3.3 
of [Giraitis et al., 2012], and the arguments leading to them. 

The dependence between the limit Hermite processes with different orders is shown in Proposition 3.1 in 
[Bai and Taqqu, 2012]. D 

4.3 Mixed SRD and LRD case 

We prove Theorem 3.5 through a number of lemmas, one lemma implying the next. 

Lemma 4.1. Follow the notations and assumptions in Theorem 3.5. Let X ™ (n) be the m-truncated multi- 
linear polynomial-form process (see (20)) corresponding to the components ofY^^Si (i ~ Ij 2j in Theorem 3.5, 
where the orders satisfy kj_Si = 1 and kj_s2 ^ 2. Let 

where (assuming that m is large enough) < (c-™ )^ :— X^n ^°^("'^i's ("•)' ''^I's A*^)) "^ °°' * = lj2. Let 
W^it):^N-^/'El''JUn,andY^^l(t) = {Y;,%{t)l..,Y^^^^^^^ The 



len 



(Y(,™)^(i),Y;;^lji),W^^(t)) ^^- (w(t),BM(t),W^(i)), (26) 

where W{t) is a standard Brownian motion, W(t) = {W{t), . . . , W{t)) (Js2-dimensional), B('"'(t) is as given 
in (21), namely, its components are standard Brownian motions with cross-covariance (22), and B'^'"'(t) is 
independent of (W(t), W{t)). 

Proof. Fix any w = (ai, . . . , aj^ , &i, . . . , hjg , c) G ]R"^si-l-./s2+i gy Cramer- Wold, we want to show that 

R^{t- w) := Y. «.-4"!i(o + E ^.■4l!2(0 + cw^{t) 

3 3 

^^■Y,a,W{t) + Y.^,B^r^{t) + cW{t) =: G(i), 



where G{t) is a non-standardized Brownian motion whose marginal variance is the limit of the marginal 
variance of i?Ar(t; w). Note that one can write 

[Nt] 



iZjv(i;w) = -^5]c/i™)(i) 

^ n—1 



where 



Ui-\n) . I: ^4S(n) + £ ^xS(n) + 



J = l '^j,Si J = l '^i.Sa 



(m) J,Sl^ ' / y (m) 
3 = 1 '-^ 

with 



cei") 



z— (m — l)n+l 

Since {t/w ('T-)}n is m-dependent, the classical functional central limit theorem applies ([Billingsley, 1956]), 
yielding in the limit a Brownian motion G{t) for Rj^{t]w). Now that the joint normality is shown, we only 
need to identify the asymptotic covariance structure as iV — )• oo of the left-hand side of (26) to the covariance 
structure of the right-hand side of (26). 

The independence between B^"^\t) and (W(t), W{t)) follows from the uncorrelatedness between YJ^^g (i) 
(involving chaos of order > 2) and (YJy'g (t), VKjv(i)) (involving chaos of order 1 only). The asymptotic 
covariance structure within Y]^"^ (t) is given in (22) (apply Theorem 3.1 to y^Pg )■ Hence we are left 
to show that the asymptotic covariance structure of (Y]y"^ (t),WV(i)) is that of (W{t),W{t)). Note that 

in (Y]y^g^(t), VKjv(O): both {X-™j(n)} and {e„} are SRD hnear processes. So applying (13) and (14) in 
Proposition 2.5 with cti = (T2 = 1, the desired asymptotic covariance structure is obtained. D 

Remark 4.2. Lemma 4.1 can be rephrased as follows: we define an empirical random measure on a finite 
interval A as: Wn{A) := -j^^n/NeA^n- Then the joint convergence in Lemma 4.1 still holds with W{t) 
replaced by {Wn{Ai), ■ ■ ■ ,Wn{Ai)) where Ai,i = 1,...,/ are disjoint intervals, and W{t) in the hmit 
replaced by {W{Ai), . . . ,W{Ai)) where W{.) is the Brownian random measure. Observe that while (26) 
involves convergence in distribution, the limit components W(t) and W{t) both involve the same Brownian 
motion W{t). 

Now we adopt some notations from [Giraitis et al., 2012] Chapter 14.3. Let Sm{^'^) be the class of simple 
functions defined on M*^ supported on a finite number of 1/M-cubes and vanishing on the diagonals. Suppose 
that ft- is a function defined on Z*^ which vanishes on diagonals. Let the polynomial form (or discrete multiple 
integral) with respect to h be 

Qk{h) ^ E h{ii,---,ik)ei^---ei^, (27) 

ii,...,ifceZ 

where ^^ ^ h(ii, . . . , i^)'^ < oo. The following lemma plays a key role in the proof of Theorem 3.5. 

Lemma 4.3. i?epkce (Y^],^(i), Y^],^(i), W7v(t)) m Lemma 4.1 by {Y'-^\{t),Y'}^l^{t),QN), where Qn = 

( Qki (fti,Ar), • . . , Qkj (hj^^N)) ) o,nd each Qkp(hp.N), P — ^, ■ ■ ■ i Jl, is a polynomial-form defined in (27) with 

the same {ei] as those defining Y'j!^^ (t) andY^g (t). Assume that the "normalized continuous extension" 
of hp^N, that is, 

hp,Nixi,...,Xkp):^N''-^^hp,N{[Nxii...,[NxkJ) (28) 

satisfy that there exists fp G i^(M'^p) for each p = 1, . . . , Jl, 



N 



lim ||/ip,Af -./p||i2(Rfcp) ^ 0. (29) 



Now define the limit vector (W(t), B'^'"'(t), l) as follows: W(t) and B(™-'(t) are as in (26), independent, 
and I ~ (ikpifp)) _i T 7 where each Wiener-Ito integral Ikp{) has Brownian motion integrator W{.) the 
same as the Brownian motion W{t) defining W(t). Then as N ^^ oo, 

(Y;;^l(0,Y^";^^(t),Q^) '^- (w(t),B(")(t),l). (30) 



Remark 4.4. Observe that B*^™^ is independent of (W,I). 

Proof. The lemma is proved by combining Lemma 4.1 with the proof of Proposition 14.3.2 of [Giraitis et al., 
2012]. By Cramer- Wold, we need to show that for any a e R'^^'i , b e R'^^2 and c e R'^^ , as iV ^ oo, 

< a, Y^^^(t) > + < b, YJ;^^^(t) > + < c,QAr >-^^-< a,W(t) > + < b,B(")(t) > + < c,I >, (31) 

where < ., . > denotes the Euclidean inner product. 

Next following the approximation argument that leads to (14.3.14), (14.3.15) and (14.3.16) in [Giraitis 
et al., 2012], one can show that for any e > 0, there exists M > and simple functions fp^e G 'S'm(K'^p), 
p ~ 1, . . . ,Jl, such that for all N > No{e) where No{e) is large enough, 

\\Qkp{hpM) ~ Qfcp(^p,e,Ar))llL2(o) < e, (32) 

Qkp{hp.<i.N) -^ Ikp{Ip,e) as AT ^ oo, (33) 

||4,(,/p,.)-/fc,(/p)||L2(o)<e, (34) 

where IMIlsj-j^) denotes the L^(il) norm. 



,]l Jk 

•''P,e,NKJl,---,Jkp) -^ ^^ -■ Jp,ef 

Set 



hp,e,Nijl,- ■ • : JfeJ := A^^'^/'/p.^C^, • ■ • ' ^)- 



Qe,N '■— [Qkp{hp^e,N)) 

V /p=l,...,Ji 

and 

h '■— Vkp(jp,f.)) p^ij^ ■ 

Now note that Qk {hp,^,^) is a multivariate polynomial (thus is a continuous function) of random variables 
of the form Wiq{^i) where A^'s are disjoint finite intervals and Wn{-) is the empirical random measure as 
given in Remark 4.2. So by Lemma 4.1 (with Remark 4.2) and the Continuous Mapping Theorem, we have 

that as A^ ^ oo, 

< a, S^] (t) > + < b, S^^ {t)> + < c, Q,,N >^^< a, W(t) > + < b, B^") (t) > + < c, I^ > . (35) 
By (32) and the Cauchy-Schwartz inequality, we infer that 

II (< c, Qat - Qe,,7v >)||l2(o) < ||c||||QAr-Q£,Ar||L2(n) < llcliy^e, (36) 

where ||.|| denotes the Euclidean norm. Similarly using (34), 

II (<c,I-I, >)|U2(o) < ||c||||I- 1,1^2(0) < ||c||V^e. (37) 

We now apply a usual triangular approximation argument (e.g.. Lemma 4.2.1 of [Giraitis et al., 2012]). 
Let 

U''i:p\t) -< a, Y(;:)^(t) > + < hM^k^t) > + < c,Qa. >, 

C/^",)(t) ==< a, Y^";)^(i) > + < h^Nk^t) > + < C, Qe,Ar >, 

t/M(t) ^< a,W(f) > + < b,B(")(t) > + < c,Ie >, 
t/(™)(t) =< a,W(i) > + < b,B(")(t) > + < c,I > . 
By (35), (37) and (36), we have that 

^M(^) f^- xi--){t) as iV ^ oo, 

U';r\t) ^^- X^"'\t) ase^O, 

limlimsup||t/(7'(i) - U^;p}{t)\\Lm^) - 0, V t > 0, 



>o 



N- 



which implies U^^\t) ^^' U^"''>it), proving (31). D 
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The next lemma gets rid of the ?7i-truncation. 



r{m) 



Lemma 4.5. Lemma 4-3 holds with the m-truncated norm,alized partial sums Ypf g,{t), « = 1,2 replaced 
with the non-truncated ones: 

Yna (t) - I ^ y. X,,s. {n)\ , ^ = 1, 2 



(w^S^--"'l. 



where Xj^Si {n) is the non-truncated multilinear polynomial-form process corresponding to the component of 
'^N.Si in Theorem 3.5, <Jj,Si '■= X)„ Cov(Xj^s.(n),Xj^S;(0)) and the limit B^"^\t) is replaced by B(t), that 
is, as A^ — > oo, 

Yjv,s,(t),Yjv,s,(t),QAr) ^^- fw(i),B(i),lV (38) 



where W(t) = {W{t), . . . , W{t)), B(t) = (Bi(t), . . . , Bj^^ (i)) are as given in Theorem 3.5. 

Proof. We apply again the triangular argument at the end of the proof of Lemma 4.3 above, but now with 
TO — > oo, namely, to show UM{t) — -> U{t), we show 

!7^")(t)-^^-C/(")(i)asiV^oo, 
U("^){t)fAi-u{t) asm^oo, 
lim limsup||C/^"'(i) - UN{t)\\L-(n) = 0, V i > 0, 

The first step follows from Lemma 4.3. The second follows from (23) since that relation implies that the 
Gaussian vector (W,B(™)(i)) converges to (W,B(t)). For the last step, apply the argument leading to 
(4.8.7) of [Giraitis et al., 2012] and hence for any t > as A^ ^ oo, 

\\Yl^l{t)~YN,jAmLHn)^G, j = l,...,Js., z = l,2. (39) 

D 

Now we prove Theorem 3.5: 

Proof of Theorem 3.5. In view of Lemma 4.5, it is only necessary to verify that the assumption on Q^r are 
satisfied, that is, we now focus on the LRD component: 



\ / p— 1, 



P=1,...,Jl 

in Theorem 3.5. Choose as kernels hp^N in (28) those obtained from Y^v.l, that is, 

[Nt] fep,t 
n— 1 i— 1 

where c{p,N) > is some normalization constant. By Theorem 4.8.2 of [Giraitis et al., 2012], (29) holds 
and so therefore does Lemma 4.5. This concludes the proof of Theorem 3.5. D 
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4.4 Weak convergence in D[0,1]'^ 

We first state a lemma which will be used to prove case 2d. 

Lemma 4.6. Let Qk{h) he a polynomial form defined in (27). If 

Y, \h{ii,...,ik)\ <oo, (40) 

ii,...,ik 

and E{\ei\^) < oo, then we have the following hypercontractivity inequality: 

E {Qk{hf) < cE {Qk{hf)\ (41) 

where c^ {Z + 2E{ef)f^ . 

Proof. Let Km be the truncated version of h, that is, 

ft-M («!, •••,«*;) = h{ii, . . . ,ife)l{ji<M,...,jfc<M}(*l, • • • ,ife)- 

By the absolute summability of /i, we have E(|Qfe(/iM) - Qk{h)\) < {E\ei\)'' J2ii>M,....ik>M \h{ii, . . . ,ik)\ ^■ 
as M — >• oo, and thus 

Qk{h) 4 Qk{h). (42) 

By (11.4.1) of [Nourdin and Peccati, 2012], we have for M > k, 

E (QkihM)') < (3 + 2E{4)f' E (Qfc(/iM)')' (43) 

In addition, 

E{\Qk{hM)\')<Ai J2 \h(ii,...,tk)\\ <oo, (44) 

\il,...,ik ) 

where A > is a constant accounting for the product of absolute moments of {ei}. Note that since h vanishes 
on the diagonals i^ = iq when p ^ q^ there is no moment-order higher than 5 involved there. 

Finally, (44) implies that {QkihuY t^ > 1} and {Qk(hM)'^,M > 1} arc uniformly intcgrable, and this 
combined with (42) and (43) yields (41). D 

Proof of Theorem 3.8. Convergence in finite-dimensional distributions follows from Theorem 3.1, Theo- 
rem 3.4 and Theorem 3.5, so we are left to show tightness in -D[0, 1]''. Since univariate tightness implies the 
multivariate tightness in the product space (Lemma 3.10 of [Bai and Taqqu, 2012]), we only need to show 
that each {Yj^Ar(t), A^ > 1} in (2) is tight with respect to the uniform metric. If Xj{n) is LRD, the tightness 
is shown in Theorem 4.8.2 of [Giraitis et al., 2012]. We only need to treat the SRD case. 

Suppose that X{n) is a process defined in (1) which is SRD. 

In case 2a of Theorem 3.8, note that X„ is now a stationary m-dependent sequence, so the weak con- 
vergence of S'Ar(i) to Brownian motion, which includes tightness, is classical ( [Billingsley, 1956] Theorem 
5.2). 

Consider next case 2b. Because e^ are i.i.d. Gaussian, X{n) belongs to the fc-th Wiener chaos, or say, can 
be written as a multiple Wiener-Ito integral of order k (see, e.g., [Nourdin and Peccati, 2012] Chapter 2.2 



s to 



and Chapter 2.7). Since the /c-th Wiener chaos is a linear space, Yiq{t) :— -7^Yjn=i-^i''^) ^'^^'^ belong; 
the /c-th Wiener chaos, and so does Yi^{t) — Y]s[{s) for any Q < s < t. By the hypercontractivity inequality 
(Theorem 2.7.2 in [Nourdin and Peccati, 2012]), we have 

E[\YN{t) - Yn{s)\''] < cE[\YN{t) - Yn{s)\^]\ (45) 
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where c is some constant which doesn't depend on s,t or TV. Note that X]nl7('^)l < °° '^^'^ ^'^ SRD 
assumption, we have 

[7Vt]-[7Vs] 

E[\Yj,{t)-Y^is)\^] = -E[\ J2 ^Wl'] 

n=l 

n=-([Art]-[Afs]) ^ L J L J/ n=-oo 

Combining (45) and (46), we have for some constant C > that 

E[\YN(t) - YN{s)f] < cE[\YN(t) - YN{s)ff < C\FN{t) - FN{s)f, 

where F/v(i) = [Nt]/N. Now by applying Lemma 4.4.1 and Theorem 4.4.1 of [Giraitis et al., 2012], we 
conclude that tightness holds. 

Case 2c is shown by Proposition 4.4.4 of [Giraitis et al., 2012] with H — 1/2. 

For case 2d, for s < t, 

^ [Nt]-[Ns] / ^ [Nt]-[Ns] 



J2 ^(")= J2 \TTm Yl «n-^l . . . an-» J e»i 



A(N) ^^ ' ' ^ \ A(N) 

^ ' n=l l<ii<...<ifc<co \ ^ ' n=l 

Thus Lemma 4.6 applies with h{ii, . . . ,ik) ~ aIn) X^L^i * '^n-n ■■■o-n-ik since (40) holds due to the 
assumption X]i>i l*^*! < °°- Tightness then follows by applying the same argument as in case 2b. D 
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